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■A Performance Management System 



INTRODUCTION 



5 



Field of the Invention 

The invention relates to a performance management system for use in a processing 
environment in which the people resources account for a large proportion of the 
10 operational cost and therefore, associated costs and revenues are dependent on the 
successful management of the performance of this resource in terms of productivity, 
quality and behaviour. A contact centre is only one example, and the invention 
applies to any business requiring performance management. 

15 Prior Art Discussion 

Heretofore, much work has been carried out on development of contact centre 
functionality such' as switches/ACDs, fax gateway, e-mail, web, Customer 
Relationship Management, quality and workforce management systems. For 

20 example, United States Patent Specification No. US5206903 (AT & T) describes 
automatic call distribution equipment which routes calls according to agent skills. 
European Patent Specification No. 0740450A2 (IBM) also describes such a system. 
PCT Patent Specification No. WO99/60766 (Callscan) describes a system to 
optimise human resource allocation in a call centre . environment. The system 

25 . includes a knowledge base, a call activity monitor, and a performance reference 
model. 



All of these developments to date focus on the following categories; 
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Contact Management 

ACD's, Fax Gateways, IVR, E-Mail, Web - to manage and either automatically 
handle or route customer contacts according to configurable routing criteria. 

5 Workforce Management 

Workforce Management Systems - used primarily to forecast anticipated workloads 
and the scheduling of the corresponding resources required to achieve self-imposed 
service level goals. 

10 Quality Assessment 

Quality Systems - focused on the monitoring and evaluation of the quality of 
customer contacts. 

Customer Relationship Management 
15 "CRM" Systems - focused on consolidating the different customer process systems 
into a single front-end and providing the employee with a contact history so that the 
customer queries can be handled better and resolved more efficiently. 

Whilst all of these systems have disparate primary functions, they all create detailed 
20 and important management information which form part of the overall picture of 
performance in any organisation. 

Objects of the Invention 

25 An object of the invention is to provide an organisation with a single source for 
performance measurement information and a configuration tool to allow an 
organisation to manipulate and exploit this data to provide all the users with a 
consolidated view of their own performance or that of their teams, departments, sites 
or business units. 

30 
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This is referred to in this specification as "information management". 

A second objective is to provide the end-users (mainly agents, team leaders and 
managers) with a process for managing performance, the process comprising the 
5 following. 

Performance Review - to facilitate individual review of one's own performance. 
Appraisal management - to provide more consistency and objectivity around the 
review/ appraisal process. 
10 Personal Development Plan - to ensure that all training and development efforts are 
more closely linked to the business objectives. . ' 
Reward Manager - calculation of reward points and the administration of a gift 
process to promote improved fairness and staff motivation. 

1 5 The combination of these is referred to in this specification as "performance 
management". 

SUMMARY OF THE INVENTION 

20 According to the invention, there is provided a performance management system for 
use in an organisation having employees worlring to achieve organisation 
performance goals, the system comprising:- 

configuration functions comprising: 

25 

an employee setup function comprising means for creating a database 
record for an employee, and 



30 



an objective function comprising means for configuring objectives for 
employee performance, 



.r 




• 
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10 



15 



20 



an information management function comprising means for capturing raw 
data, and for processing the captured raw data according to an objective to 
generate employee performance data, and 

a database comprising means for storing said performance data and for 
interfacing with the configuration and the information management 
functions. 

In one embodiment, the configuration functions comprise an objective group 
function for creating an objective group of objectives to which similar weightings are 
applied and for associating an employee record with said objective group. 

In one embodiment, the configuration functions comprise: 

a function for generating an appraisal ratings group of ratings defining how an 
employee is appraised with reference to objectives, 

a data dictionary function comprising means for creating a data dictionary 
item defining how raw data imported into the system is processed and 
displayed, and 

means in the objective function for associating an objective with an appraisal 
rating group and with a data dictionary item. 

In one embodiment, the configuration functions comprise an objective wizard 
function for configuring objectives for employee and team performance. 

In one embodiment, the objective wizard function comprises means for prompting 
input of objective description, appraisal definitions, and a rating calculation. 
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In one embodiment, the configuration functions comprises a KPI wizard function 
comprising means for prompting user input of organisation-level ratings and 
thresholds. 

5 

In one embodiment, the configuration functions comprise a KPI group review 
configuration function comprising means for grouping KPIs together for reporting 
purposes, and the information management functions comprise a KPI group review 
function comprising means for outputting group review data. 

10 

In one embodiment, the user interface, the configuration functions, and the 
performance management functions together have a structure of classes fox 
instantiating objects in a user interface layer, a business logic layer, and a data 
services layer. 

In one embodiment, the business logic class instantiates business logic objects having • 
code of a configuration or an information function, and means for terminating the 
object at the end of a user session. 

20 In one embodiment, the business logic layer executes on a business server. 

In one embodiment, the data services layer comprises a class for instantiating data 
services, objects residing on a database server and means for terminating said objects 
after a user session. 

25 

In one embodiment, the system comprises a transaction server for executing data 
services layer functions. 



In one embodiment, the transaction server comprises means for maintaining a pool 
30 of data services objects together and for maintaining a pool of database connections. 
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In one embodiment, dynamic library links for the objects are registered using proxy 
stub pairs on both a client and a server. 

5 According to another aspect, the invention provides a performance management 
system for use in an organisation having employees working to achieve organisation 
performance goals, the system comprising:- 

a configuration function comprising means for generating an appraisal ratings 
10 group of ratings defining how an agent is appraised with reference to 

objectives; 

a configuration data dictionary function comprising means for creating a data 
dictionary item defining how raw data imported into the system is processed 
1 5 and displayed; 

a configuration objective function comprising means for configuring 
objectives for employee performance; 

20 a configuration employee setup function comprising means for creating a 

database record for an employee; 

a configuration objective group function comprising means for creating an 
objective group of objectives to which similar weightings are applied, and for 
25 associating an employee record with said objective group, 

an information management function comprising means for capturing raw 
data, and for processing said data according to data dictionary items for said 
objectives and objective groups to generate performance data for an employee 
30 record associated with the objective group; and 
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a database comprising means for storing said performance data and for 

Ate 

interfacing with the configuration and information management functions. 
5 DETAILED DESCRIPTION OF THE INVENTION 
Brief Description of the Invention 

The invention will be more clearly understood from the following description of 
10 some embodiments thereof, given by way of example only with reference to the 
accompanying drawings in which:- 

Fig. 1(a) is an overview block diagram of a performance management system 
of the invention; 

15 

Fig. 1(b) is a diagram illustrating the physical architecture of I he performance 
management system; 

Fig. 2(a) is a block diagram illustrating the main functions of die performance 
20 management system; 

Figs. 3 to 4 are sample screen shots illustrating aspects of the performance 
management system; and 

25 Fig. 5 is a flow diagram illustrating linking of objectives with agents. 

Description of the Embodiments 



Overall Architecture 
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Referring to Fig. 1(a). there is shown a performance management system 1 for the 
management of performance in a customer services environment and reporting on 
same. The system 1 interfaces with external performance measurement systems 2 
comprising a switch 3, a work force manager 4, and third party systems 5 that store 
5 performance measurement data within a structured database and can produce reports 
on either employee, application, departmental or organisational performance. The 
external systems 2 do not form part of the invention, however the interface with 
these systems (API's and integration engine) are a part of the invention, as they allow 
raw data to be formatted and imported into the performance management system. 

10 

The system 1 comprises information management functions 6 which use data from a 
KPI (key performance indicator) table 10 and a results & ratings table 11 within a 
database 9 to perform calculations pertaining to individual performance of 
employees, in addition to the overall performance within the customer services 

15 centre. The information management functions 6 interact with an HTML user 
interface 7 to display to the end-user the results of the calculations performed on 
performance. The database 9 also contains configuration data tables 12. The 
contents of these tables allow the system 1 to be tailored to suit individual 
organisations, thus minimising the need for bespoke development of the system to 

20 suit particular business operations. The configuration data is captured through the 
use of configuration functions 8 and a Windows™-based interface 13, which 
provides the user with a GUI to specify the unique characteristics of the organisation. 

At a high level, die database 9 captures raw da ta from the external systems 2 in a 
25 structured manner using APIs, however, flat-file reports may alternatively be used. 
The raw data is processed by an inte gration engine 1 8 according to requirements 
configured in the integration engine. The performance data is provided in real time 
via the HTML user interface 7 in response to appropriate requests/enquiries. The 
performance data may relate to individual customer service agents, to teams, or to 
30 overall departments and even site locations. Performance is measured against 
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objective s set up during configuration, and also against KPIs. Like objectives, KPIs 
have targets but are not rated. However they do not relate to persons, but instead to 
an organisation or department as a whole. 

5 The physical architecture of the system 1 is shown in Fig. 1(b). It has a three-tier 
architecture, which consists of a user interface layer 15 supporting the functions 7 
and 13, a business services layer 16 supporting the functions 6 and 8, and a data 
services layer 17 supporting the database 9. The functions are instantiated as objects 
from user interface, business logic, and a data services classes. Objects are 
1 0 instantiated for a task such as a user enquiry session and are terminated at the end. 

User Interface Layer 15 

There are two types of user interface as follows. 

1 5 The Browser Interface 7 

This consists of a set of Web classes that reside on a Web server. Objects, instantiated 
from these classes send HTML to a client browser. The primary role of the browser 
7 is to view the data in a variety of ways i.e. graphically, tabular, by day, by month, 
by year. The browser front-end allows the measurement and management, of 

20 performance. The measurement is by viewing the data in a variety of forms, and the 
management is by allowing the user to specify (according to his security privileges) 
targets, development plans, comments and even override results. The Web server 
interfaces with user Web clients 14. 

25 The Interface 13 

This consists of a set of forms which reside in the user interface layer 15. It sends the 
configuration data direcdy to the business services layer. The primary role of the 
interface 13 is to configure the browser 7 and to determine the behaviour of the data 
within the system 1. The Windows interface allows 'tailoring' of the system to meet 
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the specific requirements and characteristics of the contact management centre, thus 
omitting the need for expensive customisation of the product. 

Business Services Laver 16 
5 This layer comprises a business server on which resides the functions 6 and 8. These 
functions perform all calculations and all validations The interface 13 directly 
accesses the business server whilst the interface 7 accesses the business server via the 
Web server. 

10 Data Services Laver 17 

The data services layer 17 comprises a data server hosting the database 9. This layers 
performs data integration with the external systems. 

A data server hosts data services objects in addition to the actual database 9. The 
15 business server calls the data services object, which then in. turn retrieve data from 
the database 9. 

The system 1 also comprises a transaction server. This handles all of the database 
transactions between the objects in the business layer and the objects in the data 
20 services layer. It holds a pool of objects together, maintains a pool of database 
connections, and allows improved scaieability and performance 

Dynamic Library Links (DLLs) are registered using proxy stub pairs on both the 
servers and on the client, When a function 6 requires the DLL, the proxy stub pairs 
25 direct the function to the DLL stored on the server. The proxy stub pairs therefore 
enable the objects to communicate with each other across multiple servers. 

Functions of System 



30 Referring now to Fig. 2, the configuration functions 8 include; 
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20 Call Centre Configuration 

21 Hierarchy Maintenance 

22 Data dictionary maintenance 

5 23 Employee Maintenance Utility 

24 Appraisal rating Group Configuration 

25 Performance Exception Codes 

The information management functions 6 include:- 

10 

50 Objective Wizard 

51 Objective Group Configuration 

52 KPI wizard 

53 KPI Group Review Configuration 
15 54 KPI Group Review 

55 KPI Manual Entry 

60 Manual Results Entry 

61 Performance Review 
20 62 Manual Ratings Entry 

80 . Report Manager Configuration 

81 Report Manager 

25 Overview of Functions 



The Data Dictionary is a feature that determines how results are generated from 
imported data and how those results are displayed. The data dictionary is populated 
by creating individual dictionary entries one at a time. Each entry defines how a 
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performance related result is generated, such as Average Handling Time, Total Calls, 
Service Level, etc. For each result obtained, the Data Dictionary entry defines: 

Where the data is obtained from (in the database). 
5 The calculations that are performed on the data to generate the result. 
How often the data is measured. 

Whose performance is represented in the result (e.g. Agents, Team Leaders, and 
Managers). 

How the data should be displayed in the system (e.g. AHT given in seconds or 
10 minutes). 

Whether the result represents a key performance indicator (KPI). 

Whether the result can be manually overwritten. 

The minimum and maximum permissible values for that result. 

15 Regarding appraisal rating groups, each group can have up to ten appraisal ratings 
that will be used when the employees are appraised and their objectives rated against 
their results. Appraisal rating groups are required because in some organisations 
employees may be appraised differently depending on, for example, which 
department or division they work for. The appraisal rating groups are used 

20 throughout the system. The company defines the review periods (monthly, 
quarterly, half-yearly, yearly) to apply for performance appraisal within the 
organisation. Up to 10 Ratings can be defined within a group. Each rating will be 
given a name, description, and an icon (for graphical representation on-screen). 

25 An Objective is a performance expectation that is assigned to an individual (agent). 
The individual is then measured against the performance criteria, e.g. average 
handling time. This measurement is compared to the objective's target and rated 
accordingly. The objective is uniquely associated with an objective class. This 
enables the system to class or sort objectives for reporting purposes. 

30 
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The company (supervisor) defines whether the objective is based on the individual's 
results or based on the results of either the team reporting to them or their peer team. 
Once this has been defined, the company also defines the measurement field (using 
data dictionary titles) to identify the data being appraised. 

5 

The measurement data for an objective may be captured automatically (from 
external, third party systems), or manually entered by a company. This data is then 
used for comparison against predetermined targets for the objective within defined 
measurement periods. 

10 . 

For team objectives, the result is based on the combined result for all individuals 
within the team. Once this has been calculated, the team's rating for that objective is 
derived by referring to the associated appraisal rating group. 

15 The company determines the target period to apply to each objective. The target 
period can be monthly, quarterly, 6-monthly, or yearly. 

An objective is automatically rated for the target period selected by the company. 
However, the company can also determine additional rating periods for the objective 
20 if required. It should be noted that the target set for the target period would apply to 
the additional rating periods. 

The company determines whether the objective is rated according to absolute result 
values or by percentage improvement (or percentage change) from the target value. 

25 

For absolute result ratings, the company defines the threshold value . for each rating 
defined for that Objective, as well as an operator (>, <, =, <=, =>) for it. Individuals 
are rated depending on which of these ratings their result falls into. 
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A % Improvement method rates an individual on how much their results deviate 
from their target. It is measured using the following formula: 

(Result - Target) / Target * 100 

5 

The resulting percentage value is then compared to the thresholds that have been 
entered and a rating is obtained. 

The company is able to define the number of points that will be allocated for each 
10 objective upon achieving the specific ratings, as well as the frequency with which 
reward points are allocated. Thus, individuals are able to receive points for achieving 
targeted performance levels. Performance is therefore linked with the objectives and 
their associated targets. 

15 Once an objective has been created the company assigns it to an appraisal rating 
group. This defines the rating categories to be applied to the results for that 
Objective. 

An objective group is a collection of objectives that have been grouped together for 
20 ease of management. 

The objectives that can be collected together are defined by: 

- The level within the organisational hierarchy for which the objective group is to 
apply. 

25 - The appraisal rating group selected. 

Each objective group is given a name and a description, and also the level of the 
hierarchy to which die new objective group will apply. 
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The ratings that apply to the selected appraisal rating group are displayed and the 
company can enter a score and edit the overall expectation for each rating. 

A score is used when calculating an employee's overall rating . An overall rating 
5 rates an employee on their overall performance, taking into account their results for 
all of their objectives. 

The concept of overall expectation relates to a process of combining ratings. 
There are two situations where ratings are combined: 

10 

i. When the ratings that an employee has achieved in each of their objectives 
are combined to give them an overall rating. 

ii. When the ratings that an employee has achieved in each target period are 
combined to given them a rating for an additional rating period. 

15 

In either of these cases, the overall expectation is used to reduce the final score 
required to achieve a certain rating. 

The company will be able to select which objectives to place within each group and 
20 specify a weighting percentage to. apply. Weighting is a means of prioritising 
objectives, so that high priority objectives carry more weight than low priority 
objectives. This prevents the system from giving an unrepresentative rating for an 
employee's performance. The total of all the weightings must add up to 100 

25 Each employee that will have objectives assigned to them must first be configured, or 
setup, into the system. The system creates and maintains a unique record for each 
employee holding basic employment information. This includes: employee name, 
system name, password, their level within the organisational hierarchy, who they 
report to, the associated appraisal group, the associated objective group, the 

30 associated report group, the associated KPI group, and the name of their team. It can 
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also hold additional, optional information: Address details, their ID's on the various 
third party systems that the system 1 interfaces to, and other related information 
(mobile phone numbers, etc). 

5 Each employee is uniquely identified with the system using employee ID number. 
This number is used to enables the system 1 to setup links to other third part systems. 

An employee is associated with at most one organisational level with the hierarchy, 
such as team leader. 

10 

An employee record will identify die individual, at the level above within the 
hierarchy, to whom he or she will report. This also identifies the team name. It also 
determines which appraisal rating groups, objective groups, report groups, and KPI 
groups can be associated with the employee. 

15 

The first person assigned to a team will dictate the Appraisal Rating Group for the 
team. Thereafter, all other team members must have the same appraisal rating group, 
regardless of the objective group. 

20 Reporting Groups allows the user to create a group which can then have reports 
associated with it. Once the reports are associated with the group then the group is 
associated with an employee, hence allowing employees to view specific reports 
according to their requirements. A KPI Group may be associated with the employee 
so that the employee can have access to the KPI data held within the KPt group. 

25 Only one KPI Group can be assigned per employee. 

Detailed Description of Functions 



Call Centre Configuration Function 20 
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The call centre configuration function 20 is used via the Windows™ interface to 
* construct the conceptual organisational hierarchy. The organisation can configure up 
to ten hierarchical levels. Fig. 3(a) shows an example for an organisation that has 
seven levels from agent through to the global organisation view. The screen of Fig. 
5 3(b) then allows the user to determine functional access (at the browser end) to the 
various performance management functions for each level as specified in the system 
hierarchy in Fig. 3(a). This is inputted in a simple Yes/No cellular structure. Because 
the defined organisational hierarchy forms a basis for the operation of many other 
functions, amendments to the same can only be made by a senior systems 
1 0 administrator with the appropriate access and user rights. 

The function 20 is coded in Visual Basic™ and refers to the characteristics of the 
customer services centre, 

1 5 Hierarchy Maintenance Function 21 

After the call centre configuration has been defined a hierarchy configuration is then 
set up for each site using the function 21. The fields completed for site configuration 
are call centre name, call centre ID, year and week start values, system days, close 
off data, currency mask and a moratorium value. 

20 

Data Dictionary Maintenance Function 22 

The data dictionary maintenance function 22 allows users to manipulate the 
measurement data that has been imported from the third party performance 
measurement systems. The primary purpose is to formulate the performance 

25 management system objective fields from all the data fields imported from the 
external third party databases or performance measurement systems. A sample 
screen is shown in Fig. 4(a), in which the user is creating a new data dictionary field 
that forms the measurement of schedule adherence (the percentage of time an agent 
actually spends signed-on to their phone against the time they were scheduled to be 

30 there). As illustrated, the user inputs a name description, associates the data 



WO 02727571 



PCT/IEOO/00114 



-18- 

dictionary field to a level in the hierarchy, and specifies the period against which the 
measurement data is captured. The level must be chosen from the set established 
when creating the organisation hierarchy. A second screen, shown in Fig. 4(b), is 
used to assign the data dictionary name to a database field or a combination of 
5 database fields and defining how these fields are to be calculated. The calculation is 
defined by a Value 1/ Operator/ Value 2 sequence. In the example Fig. 4(b), the user 
selects the field [fgn_value5] which relates to the actual time the agent was signed-in 
(taken from the ACD) and divides this by [fgnvalue21J which relates to the amount 
of time they had been scheduled to be signed-in (taken from the workforce 
10 management system 4). 



The following table sets out the field descriptions in more detail. 



Field Name 


Mandatory / 
Optional 


Field 

Behaviour 


Field Description 


Field • 




Displayed 


This column displays the database fields 
that may be entered. 


Description 




Displayed 


This column displays the description 
associated with the field. This cannot be 
edited by the user within the DDM 22 as it 
is display only. It is stored within the 
DDM. 
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Valuel 


M 


Input 
*&- 


This fields allows the user to enter the 
summation formula for the summary 
periods. 

A result will be produced for all periods 
regardless of whether the period was 
chosen as a rating period in the objective 
wizard function. 
Supported 

All approved ANSI 92 SQL Statements 
The result of this part of the formula will 
be stored in the database and used to sum 
results for period and teams 


Operator 


0 

Mandatory if 
Valuel is 
entered 


Selection 


This operator makes up the complete 
formula using Valuel arid Value2. Initially 
the data from the foreign data table is 
calculated using the full formula. To 
calculate the sum for periods and teams, 
the formula Valuel Operator Value2 will 
be used. 

Available operators 
+ •-•/•* 
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Value2 


0 


Input 


This fields allows the user enter the second 
part of the Summation Formula. This field 
may not be required for similar formulae of 
a field assignment. 
Supported 

All approved ANSI 92 SQL Statements 

The result of this part of the formula will 
be stored in the database and used to sum 
results for period and teams 


Result 




Display 


Displays the result of an expression based 
on skeleton data, when the TEST' option 
is selected. 



The following table sets out the command options. 



Command Name 


Description 


TEST 


This allows the user to test the full formula entered. A result of the 

i 

Formula is displayed from skeleton test data in the database. 


OK 


Saves any changes / additions made by the user without prompting 
for confirmation of same; and quits component / application. 


CANCEL 


If change / additions made, prompts user to save same; otherwise 
quits component / application. 


HELP 


Opens Help file for component. 



5 Fig. 4(c) shows the input screen used to define the data dictionary rules. These rules 
define how the result for the field is entered, displayed, and calculated. As illustrated 
in Fig. 4(c) the minimum and maximum values are set, as is the display mask. In this 
case ##% means diat the result will be displayed as a % and rounded up with no 
decimal places. The over-ride check box allows the organisation to control whether 
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or not these results can be over-ridden by a user's manager. The following table 
describes the inputs in more detail. 



Field Name 


Mandatory / 
Optional 


Field 
Behaviour 


Field Description 


Min Value 


0 


Input 


This field is used to restrict the input 
permitted for a manual data entry or a 
result override. The value entered must be 
greater than or equal to this value. 


Max Value 


0 


Input 


This field is used to restrict the input 
permitted for a manual data entry or a 
result override. The value entered must be 
less than or equal to this value. 


Display 
Mask 


0 . 


Input 


Determines how the result for the data 
dictionary field will be displayed. Used to 
indicate currency, percentage, minutes or 
seconds. 


KPI 


0 


Cluck 


Indicates that this data dictionary field will 
be used in conjunction with KPl's and not 
objectives 


Manual 


0 


Check 


Indicates that this data dictionary field will 
require a manager to enter a result 
manually and that data will not be 
populated automatically from the switch. 
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Field Name 


Mandatory / 
Optional 


Field 

Behaviour 
*- 


Field Description 


Override 


O 


Check 


Indicates that results for this data 
dictionary field cannot be over-ridden in 
the team performance review screen. This 
field will be used where the formula for the 
data dictionary is deemed to complicated 
to allow values to be changed. 



The following are the command options 



Command Name 


Description 


OK 


Saves any changes / additions made by the user without prompting 
for confirmation of same; and quits component / application. : 


CANCEL 


If change / additions made, prompts user to save same; otherwise 
quits component / application. 


HELP 


Opens Help file for component, if in WinHelp then the topic is 
generally (but not always) specific to the tab / component the user 
is currently using. 



5 The following are the business rules. 



Description 


If the data dictionary created is to be used to provide data for 
the key performance indicators (KPPs), then it must be entered 
above the highest level specified. 


Reason 


Entering the data dictionary that is to be used in conjunction 
with a KPI at the highest level 
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Typical 
Scenario 


A data dictionary is to be created for Average Handling Time, 
this will also be later used as a Key Performance Indicator. The 
level for the AHT would have be the level higher than the 
highest level specified in Hierarchy Maintenance, i.e.: if the 
highest level in Hierarchy Maintenance was 'Organisation' at 
Level 7, then the Data Dictionary for AHT must be specified at 
Level 8. 


The following are the best practices. 


Description 


The display mask must be configured to reflect the maximum 
characters as specified in the 'Max Value* field, i.e. if the 
maximum value is 4 characters (1000) then the display mask 
must provide provision for 4 characters (###0) 


Reason 


The input mask must provide provision for all the characters 
entered into the data dictionary field 


Typical 
• Scenario 


A manual entry data dictionary is set-up called 'revenue' , which 
will have a maximum amount of £1,000,000. The call centre 
wish this to be displayed with commas separating every 3 
characters, a '£' sign and to 2 decimal places, therefore the input 
mask is specified as '£#,###,##0.00 



5 Employee Maintenance Utility 23 

The employee maintenance utility 23 creates an employee (agent). The inputs 
include name, password, password confirm, organisation hierarchy level, a manager 
to whom the employee reports, an ID, an objective group of which the employee is a 
member, a team name, a flag indicating whether KPI data will be attributed to the 
10 employee, addresses, system ID, and any additional information. The following 
business rules are applied to employee creation, objective creation, and objective 
modification. 
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Employee Creation 



Description 


Before assigning an employee, a manager, team name or 
objective group, the employee must be assigned a level 


Reason 


The level determines the possible managers, teams and 
objectives that the employee could be assigned. 


Typical 
Scenario 


An employee is assigned to manager *X\ belongs to team *Y' 
and has objective group *Z\ Before any of these are specified the 
employee must be assigned a level such as 'Agent'. 


Objective Creation 


Description 


All employees that share the same manager must be of the same 
level and the same appraisal group. 


Reason 


The system 1 only allows provision for a manger to manage 
employees of a single level. Employees must share the same 
appraisal group as die performance review assumes only one 
appraisal group throughout the team. 


Typical 
Scenario 


As employees are entered onto the system 1 and assigned 
managers, only those at the same level and who share the same 
appraisal group will be allowed to be entered into the same 
team. 


Objective Modification 


Description 


An employee's objective group can be amended after it has been 
specified. In the event of an employee's objective group being 
amended more than once in a single day, all intermediate 
objective groups will be deleted and all results and ratings will 
be attributed to the final objective group. 
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Reason 


Each objective is specified to an employee. When a new 
objective is assigned, the current date is attributed to the start 
date of the new objective. The previous objectives end date is set 
as the previous days date. 


Typical 
Scenario 


The firm intends to move an employee from objective group 'A* 
to objective group TB 1 , however it accidentally moves the 
employee to objective group 'C\ The mistake is later rectified 
on the same working day, any results and ratings that were 
collected and attributed for objective group . *C will be 
reallocated to objective group *B\ 



Appraisal Rating Group Configuration Function 24 

The appraisal rating group configuration fimction 24 allows the user to define 
appraisal rating groups. Each group can have up to ten appraisal ratings, which will 
5 be used when to rate individual employee's objectives. 



The review periods available for the system are also defined within this utility. These 
review periods dictate the 'period selection tabs' displayed in functions such as 
personal performance review and appraisal manager, as well as dictate the periods 
10 (apart from daily and weekly) when ratings can occur as set out in the objective 
wizard function. 

The user creates the appraisal rating groups and these will be used throughout the 
system. These appraisal ratings form an integral part of the system. Separate- 
1 5 appraisal rating groups would be set up where a different function in the organisation 
might wish to rate individuals in a different fashion. 

The input screen defines an appraisal rating group and the appraisal review periods 
that apply to it. This screen allows the user to configure appraisal rating groups 
20 which are used in conjunction with objective wizard, objective group configuration - 
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objective group rating, appraisal manager, personal performance review. The user 
configures appraisal rating groups, which appear on all the above screens. There is a 
maximum of ten Appraisal Ratings per group and more than one appraisal rating 
group can be created. The users must ensure that they select all the review periods 
5 required for all objectives i.e.: they might only have a requirement to review sickness 
and absence at the 6-month juncture. However, they must select 6 month and it will 
apply to all. The review period is by appraisal group and not by objective. 

Performance Exception Codes Configuration Functions 25 
10 The performance exception codes configuration function 25 allows the user to 
configure standard codes which can be used by an individual's manager to over-ride 
their performance for given reasons like system issues, health etc. This functionality 
ensures that the system 1 allows discretionary management decisions within the 
organisation but has a means of tracking and reporting on these. 

15 

The basic principle behind this is that the agents (and team leaders) take 
responsibility for then own performance and enter comments against their 
performance (good or bad) in personal performance review. The manager then has 
the ability to exclude/override the result for that day from their overall result and 
20 from any averages. They must however enter a code for the exception; this will be 
reported to management and will highlight the various reasons for excluding bad 
results. This screen is. the configuration screen to set up the standard reason codes 
and is mainly used during the initial system installation. Ongoing changes or 
additions may be needed as the conditions change. 

25 

Objective Wizard Function 50 

An objective wizard function 50 defines an objective. An objective is a performance 
expectation assigned to an individual and is set up using the objective wizard 50. 
The wizard function 50 prompts input of the following values. 
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Field Name 


Mand. 
/Opt. 


Field 
Behaviour 

- — — *w 


Field Description 


Objective 
Name 


M 


Input 


Name of new objective e.g. average 
handling time 


Description 


M 


Input 


Free-format textual narrative explains 
the overall purpose of the objective. 


Appraisal 

Rating 

Group 


M 


Input - Pre- 
defined List 


This field allows a user to assign an 
appraisal rating group to an objective, 
thereby allowing the user to review 
and appraise many objectives 
together. 


Objective 
Class 


0 


Input - Pre- 
defined List " 


This field allows the user to associate 
an objective class with an objective. 
It allows the user to class/ sort 
objectives for reporting purposes 
only. 



A next step prompts input of data indicating the source of data for the objective. The 
following are the inputs. 

' - ■ s 



Field Name 


Field 
Behaviour 


Field Description 


Rating - 
Calculated 


Option 


The rating will be calculated by an overnight process 
based on results and rating methods 
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Field Name 


Field 

Behaviour 


Field Description 


Rating 
Manual 


Option 


The rating be will manually entered by a team leader 
or manager for each target period (as specified on 
the next screen). This rating will be added together 
for periods greater than the target period. 

When this entry is selected, no data dictionary field 
needs to be selected as we are giving a rating for the 
objective and no data or results are required to 
compute the rating. The data dictionary and result 
type section will be disabled. The rating will always 
by applied to individuals . 

The additional rating periods category in a next 
screen will be disabled. The target period will define 
the period for which manual rating is entered. 

After the target period is selected m the following 
screen, the final screen, "Finished", will be 
presented in the objective wizard function. 


DDField - 
Standard 


Option 


The measurement data is automatically captured - 
from the A CD Switch for example. The drop down 
will list only non-KPI, non-manual data dictionary 
items. 


Manual 
Result Entry 


Option 


The user will have to key in the result, which will be 
used in the objective. The drop-down will list only 
non-KPI, manual data dictionary items. 
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Field Name 


Field 

Behaviour 


Field Description 


DD Field - 
Drop Down 


Selection 


Lists AH data dictionary fields that are not set up for 
KPI and are manual only if the Manual Option is 
selected. 

The data dictionary field defines the Measurement 
Period for the objective. One cannot select a target 
or rating period lower than this measurement period. 


Result based 
upon 

Individual 


Option 


The objective will use an individual result when 
calculating the rating. Objectives of this type may 
only be assigned to employees at the same level as 
the data dictionary field associated with the 
objective, or a higher level. 


Result based 
upon 
Reportee 
Team 


Option 


This is, in effect, the same as Individual results. 
Individual and reportee team are treated the same by 
the system. Starting at the level associated with the 
. data dictionary field, results are always summed up 
into teams. The team result for Level I becomes the 
individual result for Level 2 and so on. This field 
makes it clearer to the user what type of objective is 
being set up. 
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Field Name 



Field 
Behaviour 



Field Description 



Result based 
upon Peer 
Team 



Option 



The objective will use the team result when 
calculating the rating. Objectives of this type may 
only be assigned to employees at the same level as 
the data dictionary field associated with the 
objective or, employees at a level higher than the 
data dictionary level. The objective is always, in- 
effect a peer objective, i.e. the employee will be rated 
.on the result of the team that he is part of. The result 
and rating that he will see will be stored on the 
database with his manager. 

When these objectives are assigned to team 
members, pseudo objectives are assigned to the team 
leader. No calculation of ratings is performed for 
the team members, but rather they see the result and 
rating for the team that is assigned with the team 
leader. 

If team peer result is selected, the objective will only 
be rating using absolute values; i.e. the rating 
method screen will not be shown and absolute only 
will be assumed. 



The function 50 then proceeds to prompt input of rating periods, rating methods, 
absolute thresholds, and to improvement thresholds. For example, the rating 
method maybe based on either an absolute result or a percentage improvement on 
5 the initial target set. . 



Objective Group Configuration Function 51 
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The objective group configuration function 51 allows users to create and administer 
objective groups for the purposes of easy handling of objectives. The only constraint 
for groups is that the objectives have the same appraisal definitions. The objective 
group is defined by: 

5 

- name, - 

- selected appraisal rating group, 

- description, and 

- objectives within the group. 

10 

The function 51 also allows a percentage weighting to be applied to each objective 
within the group. Also, random sample ratings may be applied to each objective. 

Linking of objectives to agents 

15 

As stated above, the information management functions 6 link agents (individuals) to 
objectives. This is very important as it allows individual agents to "take ownership" 
of their own performance, aligned to the overall business goals of the organisation, 
thereby contributing to the overall business success. This is achieved by linking 
20 items together as shown in Fig/5. The chain is as follows:- 

creating a data dictionary field in step 30, 

creating an appraisal rating group in step 31, 

25 

linking the data dictionary filed and the appraisal rating group with an 
objective in step 32, 



30 



in step 33 associating the objective with an objective group, and 
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in step 34, associating the objective group with an agent. 

Also, as shown by the interrupted lines the report groups and KPI groups are also 
associated with the agent in steps 35 and 36. The following summarises the meaning 
5 and significance of these items which are linked together. 

KPI Functions 52-55 

The KPI configuration functions 52, 53, and 54 allow users to define all the key 
performance indicators associated with the call centre or a subset of the call centre 

1 0 such as customer services. The KPIs are similar to objectives except that they are not 
assigned to individuals and are not rated. They are merely used to report status. 
Typical KPIs are Service Level, Abandon Rate, Number of Calls, Total Revenue etc. 
If the system 2 has been configured to have more than one Skill Group e.g.: 
Customer Services and Telesales, then there is a group of KPIs for each of these i.e.; 

15 Customer Service Level, Telesales Service Level. The KPI data can often be more 
frequent than employee objective data, which has a minimum measurement period 
of one day. The system 2 typically produces service level and other information 
associated with skill groups (also called applications or queues) every half-hour. This 
means that the system receives half-hourly KPI data from the customer services 

20 system 2. 

The KPPs are not rated but they have a target for reference purposes. For example, a 
call centre might state that the abandon rate target is 5% or less. This can then be 
shown on a graph or report alongside the actual data to show how the call centre is 
25 performing. 

The KPI wizard 52 prompts definition of: 

- KPI name and description, 
30 - a static target for each month, 
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- additional targets, and 

- rules. 

In a typical scenario, a manager wishes to see the Abandon rate for the call centre on 
5 an intra daily basis. A KPI will be set-up to capture this data, and the results will be 
reviewed via the KPI group review utility and these results are presented in tabular or 
graphical format. For an effective call centre the manager requires that the Abandon 
rate is no more than 5%. Therefore, he would enter 5% in the target. As the manager 
would like to view this on an intra-day basis, the intra-day, daily and weekly check 
1 0 boxes would need to be ticked. 

Regarding targets, in a typical scenario a manager wishes to see the days taken 
absent due to sickness for the call centre on a yearly basis. A KPI will be set-up to 
capture this data, and the results will be reviewed via the KPI Group Review utility 

1 5 and these results are presented in tabular or graphical format. If the manager wishes 
to specify the target for the number of days taken absent due to sickness as 40 in a 
year, the manager would then need to specify in the yearly column the target of 40. If 
die manager wanted to view the achievement of the target on a quarterly or half 
yearly basis, then the values of 10 would be needed to be entered for each quarter 

20 and the value of 20 for each half year. This also allows the manager to weight the 
absences (i.e. allow more absences in the winter months than the summer months). 

Regarding the rules, in a typical scenario a manger wishes to specify the target for the 
abandon rate as no more than 5%, therefore, the manger would need to set-up a KPI 
25 for abandon rate and specify the target as 5%. The manager would then need to 
check the "<=" box, thus informing the system 1 that any value below the 5% target 
would be considered as meeting the target. The manager would then need to specify 
how the next years targets for the KPI would be calculated. 
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The KPI group review configuration function 53 allows a user to group a number of 
KPIs together for reporting purposes. The KPI group review function 54 allows 
viewing of KPI data as set up by" the wizard 52. The functions 52, 53, and 54 all 
operate with the KPI table 14, which is dedicated to KPI data only. 

5 

The team leaders and managers may also use this to reward people where there is no 
set objective against the action, (i.e. a customer phones in stating that they were 
pleased with the service they received from an agent). 

10 It will be appreciated that the invention provides for effective centralised 
performance measurement and reporting, while also greatly assisting with people 
management in a flexible manner. The system also provides for automated appraisal 
and reward administration. The ability of agents to view their own development 
data is very significant as it enhances team participation. The linking of objectives to 

15 agents is particularly important at achieving the overall business goals of an 
organisation. 

The invention is not limited to the embodiments described but may be varied in 
construction and detail within the scope of the claims. 
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Claims 



10 

15 
20 

2. 

25 

3. 

30 



A performance management system for use in an organisation having 
employees working to achieve organisation performance goals, the system 
comprising:- 

configuration functions comprising: 

an employee setup function comprising means for creating a database 
record for an employee, and . 

an objective function comprising means for configuring objectives for 
employee performance, 

an information management function comprising means for capturing raw 
data, and for processing the captured raw data according to an objective to 
generate employee performance data, and 

a database comprising means for storing said performance .data and for 
interfacing with the configuration and (he information management 
functions. 

A performance management system as claimed in claim 1, wherein die 
configuration functions comprise an objective group function for creating an 
objective group of objectives to which similar weightings are applied and for 
associating an employee record with said objective group. 

A performance management system as claimed in claims 1 or 2, wherein the 
configuration functions comprise: 
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10 



15 



20 



a function for generating an appraisal ratings group of ratings defining how an 
employee is appraised witlj reference to objectives, 



item defining how raw data imported into the system is processed and 
displayed, and 

means in the objective function for associating an objective with an appraisal 
rating group and with a data dictionary item. 

4. A performance management system as claimed in claim 1, wherein' the 
configuration functions comprise an objective wizard function for configuring 
objectives for employee and team performance. 

5. A performance management system as claimed in claim 4, wherein the 
objective wizard function comprises means for prompting input of objective 
description, appraisal definitions, and a rating calculation. 

6. A performance management system as claimed in claim 1, wherein the 
configuration functions comprises a KPI wizard function comprising means 
for prompting user input of organisation-level ratings and thresholds. 

7. A performance management system as claimed in claim 6, wherein the 
configuration functions comprise a KPI group review configuration function 
comprising means for grouping KPIs together for reporting purposes, and the 
information management functions comprise a KPI group review function 
comprising means for outputting group review data. 



a data dictionary function comprising means for creating a data dictionary 



30 



8. 



A performance management system as claimed in claim 1, wherein the user 
interface, the configuration functions, and the performance management 
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ftinctions together have a structure of classes for instantiating objects in a user 
interface layer, a business logic layer, and a data services layer. 

A performance management system as claimed in claim 8, wherein the 
business logic class instantiates business logic objects having code of a 
configuration or an information function, and means for terminating the 
object at the end of a user session. 

A performance management system as claimed in claim 9, wherein the 
business logic layer executes on .a business server. 



11. A performance management system as claimed in claim 10, wherein the data 
services layer comprises a class for instantiating data services objects residing 
on a database server and means for tenninating said objects after a user 

15 session. 

12. A performance management system as claimed in claim 10, wherein the 
system comprises a transaction server for executing data ^services layer 
functions. . 



13. A performance management system as claimed in claim 12, wherein the 
transaction server comprises means for maintaining a pool of data services 
objects together and for maintaining a pool of database connections. 

14. A performance management system as claimed in claim 10, wherein dynamic 
library links for the objects are registered using proxy stub pairs on bodi a 
client and a server. 



• 



10 
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15. A performance management system for use in an organisation having 
employees working to achieve organisation performance goals, the system 
comprising: - 

a configuration function comprising means for generating an appraisal ratings 
group of ratings defining how an agent is appraised with reference to 
objectives; 

a configuration data dictionary function comprising means for creating a data 
dictionary item defining how raw data imported into the system is processed 
and displayed; 



a configuration objective function comprising means for configuring 
objectives for employee performance; 

a configuration employee setup function comprising means for creating a 
database record for an employee; 

a configuration objective group function comprising means for creating an 
objective group of objectives to which similar weightings are applied, and for 
associating an employee record with said objective group, 

an information management function comprising means for capturing raw 
data, and for processing said data according to data dictionaiy items for said 
objectives and objective groups to generate performance data for an employee 
record associated with the objective group; and 

a database comprising means for storing said performance data and for 
interfacing with the configuration and information management functions. 
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Fig. 4(b) 
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